Tap these Model Context Protocol servers to supercharge your AI-assisted coding tools with powerful devops automation capabilities.
* **GitHub MCP Server:** Enables interaction with repositories, issues, pull requests, and CI/CD via GitHub Actions.
* **Notion MCP Server:** Allows AI access to notes and documentation within Notion workspaces.
* **Atlassian Remote MCP Server:** Connects AI tools with Jira and Confluence for project management and collaboration. (Currently in beta)
* **Argo CD MCP Server:** Facilitates interaction with Argo CD for GitOps workflows.
* **Grafana MCP Server:** Provides access to observability data from Grafana dashboards.
* **Terraform MCP Server:** Enables AI-driven Terraform configuration generation and management. (Local use only currently)
* **GitLab MCP Server:** Allows AI to gather project information and perform operations within GitLab. (Currently in beta, Premium/Ultimate customers only)
* **Snyk MCP Server:** Integrates security scanning into AI-assisted DevOps workflows.
* **AWS MCP Servers:** A range of servers for interacting with various AWS services.
* **Pulumi MCP Server:** Enables AI interaction with Pulumi organizations and infrastructure.
* **GitHub MCP Server:** Enables interaction with repositories, issues, pull requests, and CI/CD via GitHub Actions.
* **Notion MCP Server:** Allows AI access to notes and documentation within Notion workspaces.
* **Atlassian Remote MCP Server:** Connects AI tools with Jira and Confluence for project management and collaboration. (Currently in beta)
* **Argo CD MCP Server:** Facilitates interaction with Argo CD for GitOps workflows.
* **Grafana MCP Server:** Provides access to observability data from Grafana dashboards.
* **Terraform MCP Server:** Enables AI-driven Terraform configuration generation and management. (Local use only currently)
* **GitLab MCP Server:** Allows AI to gather project information and perform operations within GitLab. (Currently in beta, Premium/Ultimate customers only)
* **Snyk MCP Server:** Integrates security scanning into AI-assisted DevOps workflows.
* **AWS MCP Servers:** A range of servers for interacting with various AWS services.
* **Pulumi MCP Server:** Enables AI interaction with Pulumi organizations and infrastructure.
Logward is an open-source log collector and viewer designed for small environments like home labs. It offers a modern interface and supports Sigma rules for log detection and alerting.
Ship measurable improvements in your GenAI systems with Opik, your open-source LLM observability and agent optimization platform. Trusted by over 150,000 developers and thousands of companies.
The article advocates for NixOS as an excellent operating system for home labs, highlighting its declarative configuration approach, reproducibility, and immutability. It provides a step-by-step guide on installing NixOS in Proxmox, including addressing potential UEFI boot issues. It also explains how to configure and update NixOS, and discusses its strengths and weaknesses compared to other distributions. Finally, it introduces NixOS Anywhere as a tool for automated deployment.
A Python-based log analyzer that uses local LLM (Llama 3.2 to explain the errors in simple language and summarise them (again, in simple language)
Elastic's new Streams feature uses AI to transform noisy logs into actionable insights, helping SREs diagnose and resolve issues faster. The article discusses how AI is poised to become the primary tool for incident diagnosis and address skill shortages in IT infrastructure management.
Here's a breakdown of the technical details:
* **Problem:** Modern IT (especially Kubernetes) generates massive amounts of log data (30-50GB/day per cluster) making manual analysis for root cause identification slow, costly, and prone to errors. Existing observability tools often treat logs as a last resort.
* **Elastic's Solution (Streams):**
* **AI-powered Parsing & Partitioning:** Automatically extracts relevant fields from raw logs, reducing manual effort.
* **Anomaly Detection:** Surfaces critical errors and anomalies from logs, providing early warnings.
* **Automated Remediation:** Aims to not only identify issues but also suggest or automatically implement fixes.
* **Workflow Shift:** Streams aims to move away from the traditional observability workflow (metrics -> alerts -> dashboards -> traces -> logs) to a log-centric approach where AI proactively processes logs to create actionable insights.
* **Future Direction:** The article highlights the potential of **Large Language Models (LLMs)** to further automate observability, including generating automated runbooks and playbooks for remediation. LLMs could also help address the shortage of skilled SREs by augmenting their expertise.
* **Integration:** Streams is integrated into Elastic Observability.
Here's a breakdown of the technical details:
* **Problem:** Modern IT (especially Kubernetes) generates massive amounts of log data (30-50GB/day per cluster) making manual analysis for root cause identification slow, costly, and prone to errors. Existing observability tools often treat logs as a last resort.
* **Elastic's Solution (Streams):**
* **AI-powered Parsing & Partitioning:** Automatically extracts relevant fields from raw logs, reducing manual effort.
* **Anomaly Detection:** Surfaces critical errors and anomalies from logs, providing early warnings.
* **Automated Remediation:** Aims to not only identify issues but also suggest or automatically implement fixes.
* **Workflow Shift:** Streams aims to move away from the traditional observability workflow (metrics -> alerts -> dashboards -> traces -> logs) to a log-centric approach where AI proactively processes logs to create actionable insights.
* **Future Direction:** The article highlights the potential of **Large Language Models (LLMs)** to further automate observability, including generating automated runbooks and playbooks for remediation. LLMs could also help address the shortage of skilled SREs by augmenting their expertise.
* **Integration:** Streams is integrated into Elastic Observability.
A configuration as code language with rich validation and tooling.
Platform Engineering Labs has released formae, an open-source infrastructure-as-code platform designed to address limitations in existing tools, focusing on automatic discovery, codification of existing infrastructure, and a reconcile/patch workflow. It uses PKL instead of HCL and targets reducing drift and complexity.
This article details how Nubank built its own in-house logging platform to address issues of cost, scalability, and control over their logging infrastructure. Initially reliant on a vendor solution, they found costs rising unpredictably and experienced limitations in observability and data retention.
To solve this, Nubank divided the project into two major steps: **The Observability Stream** (ingestion and processing) and the **Query & Log Platform** (storage and querying).
* **Observability Stream:** Fluent Bit for data collection, a Data Buffer Service for micro-batching, and an in-house Filter & Process Service.
* **Query & Log Platform:** Trino as the query engine, AWS S3 for storage, and Parquet for data format.
The new platform currently ingests 1 trillion logs daily, stores 45 PB of searchable data with a 45-day retention, and handles almost 15,000 queries daily. Nubank reports the platform costs 50% less than comparable market solutions while providing them with greater control, scalability, and the ability to customize features. The project underscored Nubank's value of challenging the status quo and leveraging a combination of open-source and in-house development.
To solve this, Nubank divided the project into two major steps: **The Observability Stream** (ingestion and processing) and the **Query & Log Platform** (storage and querying).
* **Observability Stream:** Fluent Bit for data collection, a Data Buffer Service for micro-batching, and an in-house Filter & Process Service.
* **Query & Log Platform:** Trino as the query engine, AWS S3 for storage, and Parquet for data format.
The new platform currently ingests 1 trillion logs daily, stores 45 PB of searchable data with a 45-day retention, and handles almost 15,000 queries daily. Nubank reports the platform costs 50% less than comparable market solutions while providing them with greater control, scalability, and the ability to customize features. The project underscored Nubank's value of challenging the status quo and leveraging a combination of open-source and in-house development.
An effort to create a fully functional Kubernetes cluster with 1 million active nodes. The article details the challenges and solutions for scaling Kubernetes to this size, covering networking, state management (etcd), and the scheduler.
